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INSTRUCTIONAL TIME: A WINGED CHARIOT? 
Gses l«inhardt 
tearnltig Research snd pevelopnent Center 
University of Pittsburgh 
May, 1981 



But it my bsck I always hear 
Time's winged chariot hurrying tiear; 
And yonder ill before us He 
Deserts of vast eternity^ 

Andrew Marville 

As I uhderitahd our task, we were to present a brief overview of 
our own research and findings, suBmarlre the najbr points that we have 
learned about time, and give some estimates as to what we think the 
future of this line of research holds. I would like to report oh three 
fairly separate studies that 1 think are illustrative of the way the 
field has gone, and certainly the way my own chinking , has gone, 
^ . _ 

Science Study 

The first study that I'd like to describe Is The Science Stwty . 
This study was csrried out in ll^/i as part of the evaluation of the 
teaming Resesrch and Development Center's (LRDC) Indlvldualtred Science 
Currlculii (IS) (Chaapagne & Kloplir, 1974). In eviluating IS We were 
faced with the difficulties of having a weak set of dependent aeasures, 
and of having qb pblht of c.^mparlsoh. There are virtually no noras for 
sucess or failure in eleaehtary science Ihstructlbh (I^lnhardt* 1977). 
In general. In the eleaentary schools In Western Pennsylvanis , tjdehts 
are not exposed to science education, io that any child that is taught 
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anything tt clearly going Co lootc BeCeer than a child that hain't beeii 
taught anything at all. One aerloua concern, even in 1974, waa whether 
or not time apent In aclence detracted from learning In the more basic 
areas. What we did was to construct a composite pre and posttesc 
battery and eitlmate time apent lii aclence, math, and reading 
instruction, the preust conkisted tf?'~^he previous year's end-of-year 
SAT (Stanford Achievement Test ; y^^^dden, Gardner, Rudqan, Karlsen, & 
Mervrln, 1972) ttanlnes In science, mith, atid reading; the posttSst 
consisted of the Spring 1975 stahlhes. the modified sllbcated time 
measures consisted of students' own punched clock records In math and 
reading and teacher logs of time npent In science . All the time 
estimates are closer Co allocated than engaged estimates, but they are 
lower than strict schedule*-ba8ed allbcatlbhs. The study wss carried out 
in bakieaf School, a demonstration school for LRDC and included sail 86 
fourtli and fifth graders enrolL^d. The results Indicated that after 
pretest, the only other Important predictor of test performance was time 
spent in acience. 

Insert Table 1 here 



Table 1 shows the means, stsndard deviations, cbrrelation matrix, 
partial correlation malrix, and regreasions. Notice t'lat the zero-order 
correlation of time ipetit In aclence with outcomea la negligible, 
whereas the math time la quite iubstantial. However, when the partial 
correlations are examined, acience time emergea mi an important 
predictor. The regression reaulta are similar. Why ia thia? Well, 
first of ill, science tlM !■ not correlated with Initial ability. 
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whereas, tine spent in math and reading is. Secondly, tiae spent in 
science reinforces reading comprehension by having action^based (follow 
the directions) short passages (two to three pages). Third, the science 
material Is very well written. There is also some limited amount of 
measuring and calculation that is required which reinforces matfi skills. 
The initial analysis consisted of correlations and partial correlations. 
By We knew that the Initial ability of the student was the most 

powerful predictor of outcome and that many of one's favorite .classroom 
process variables, time among them, was' confounded' with initial abilityT 
We knew, therefore, that simple correlations with outcome might be 
deceiving because one was really capture «rg only relationships between 
process and input , so we knew to partial them. The regression atialyals 

has been added in an attempt to have comparable results across the 

— - ^ 

studies* The regression results are consistent with the partial 

cor relations . 

One value of this study, it seems to me, is ta point out the need 
for caution. As we strive to get schools and teachers to increase the 
^ii^ged time spent by their students in academically fruitful 
activities, we must be ^careful about the Inappropriate ltier«fts^ or 
decrease in allocated time in ^ subject areas. Ai allocated time In 

r _ C_ 

language arts creeps up from 60 to 120 minutes a day^ time Is taken away 
from substantive areas such ai science and social atudies, areas which 
undoubtedly have benefit for their bwii sake but which Say tiaVe 
unanticipated benefits for the so-called basics as well. 
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IDS 

Let me turn now Co Che second sCudy. this sCudy is Che 

•4 

InsCrucCiotial Dimensions SCudy (IDS). Ic was designed by William Cooley 
and myself at Che request of Congress and NIE; It was carried Out by 
kirschner AssociaC^s and EducaCion Turnkey. Hugh Pdyhdr, Lee Poyhor, 
Charles Blaschke, and Jack Sweeney were Che primary movers in Che acCual 
conduct of Che sCudy, and William Cooley and I wroCe up Che resulcs and 
reported oh them (Cooley S Leihhardt, I960). 



The design of IDS had several distinguishing features, 
including its use of a model of classroom processes, the 
direct measurement of these processes, and disjtihctive outcome 
measures^ sampling procedures and methods of analysis. Each 
of these features is briefly described . . . 

A aiedel ^ ^la^rbon process ^ The model used by IDS for 
the study of classroom processes is illustrated in Figure I^ 
(Cooley S Leinhardt, 1975c; Cooley & Lohnes, 1976). The 
figure ' identifies cbhisttructs — sets of variables — that we 
believe are necessary to explain the variation in itudeht 
performanc** that occurs among classrooms after an extended 
period of Instruction in those clasarooms. It suggests that 
criterion performance is a futictloti of initial student 
performance and of certain classroom processes that occur in 
the interval between the assessment of initis!. performance and 
the issessmehc of criterion performance (it does not^ however, 
specify the exact nature of thoie functional relationships). 



7 



Classroom cprocesses are represented by four cbhst^ructs: 
opportunity, motivators^ instructional events, and structure- 



InserC Ftgure 1 here 



The opportunity construct represents the student's 
opportunity to learn what io tested in the criterion 
performance measures. This construct incorporates hov time is 
spent in classrooms and the similarli^y of the curriculim to 
the tests. The motivators construct includes those aspects of 
the curficuXum and in-class interpersonal behavior that 
encourage learning. Instructional events include the conCeiiC, 
frequency, quality and duration of instructional ihteractibhs . 
Structure, the fourth construct, considers the level of 
brgahlzatlbh of the curriculum, the specificity of the 
objectives, and the manner in which a student and a curricult^ 
are matched. . • 

Measures of classroom processes . From published research 
we identified Che measurable features of each construct an& 
selected measurement procedures that minimized claistObn 
disruption and maximized precision. Measures within s 
construct were combined into variables, which were in turn 
combined into sets of varibles "representing the four 
constructs. . • 
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Meaaures of £uCcoae. The atu^y .used comnerclall 



available achievenenC tests in reading and mathematics. . . 
The test battery selected was the Comprehensive Testi^of Basic 
Skills (CTBS, 197^) of the California Test Bureau; level B 
was used in grade 1, and level 1 in grade 3. . . 

Sampling procedures . The sampling scheme emphasized the 

heed to achieve variance in classroom processes, rather than 

representativeness of current compensatory practices. This 

variation in processes was obtained by usfhg descriptive ' 

information about the programs in use in a large ninber of 

school districts and then selecting classrooms from those 

_____ <| . 

districts that would increase the liRelihbbd of process 

variation. . • 

Methods of analysis . The analytic procedures recognized s 
that various classroom practices naturally' occur in 
combinations that are not susceptible to experlaehtal control. 
At this stage o>f our understanding we need a technique for 
determining the relative Importance of different practices in 
explaining variations in student achlevoDeht. (Cooley & 
teinhardt, 1980, pp. 8-9.) 

The analysis that was. used 1ft IDS wss commonality analysis. the 

results strongly suggest that the most Important of the predictors in 

the npdel were pretest and. opportunity to learn. Opportunity cbhslited 

\ •• _ _ _ 

of two variables: time and curriculum overlap, time was estimated by 

attendance, allbcatlbh, and on task rate as well as enrollment and 

transfers; overlap used a teacher-baied estimate and a carrlculum 
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th first grade, for boCh reading and math, the pretest 

and the opportunity variables were the most useful predictors 

__y_ 

of gain in achievement; opportunity was by .far the best 

predictor of reading gain; whereas pfecesc and opportunity 

had identical uniquenesses in math. 

third'grade reading showed the highest ^correlation 
between protest and ^osttest (r ■".86), leaving the smallest 
amount of reliable variance for other predictors to explain. 
Even so, the usefulness of pretest and the dppbrtuhity in 
predicting gain is about as great as for first-grade 
mathematics. . . Third-grade ;,math also shows the importsnce 
af Che opporCuhlty construct; It was, iii fact, the only 
consruct that had a significant uniqueness for this sample (in 
all other samples, at least two constructs were significant). 
In siTOary, the most useful (^nstruct for explaining 
achievement gain is the opportunity that the children had to 
learn the skills assessed in the achievement te^*-. . . 
(Cooley & Leinhardt, i960, p. 20.) 

The Impottunce of curriculum content . Curriculum content 
is btie area in which clsssroom practice ieemi to matce s 
difference^ Instructional techniques, both curriculsr shd 
interpersonal , do not compensate for aissing content . 
Children perform better on s test if they have been exposed to 
both the form of the test items and the cohteht covered by Elie 
test. This point may seem trivial, but it is in fact quite 
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importaiiC - 



Boch what is taught and what Is tested repre^sent 



saopXliigs from domains. Curriculum aiid test caii clearly 



•mphasize different content- The results of IDS show that 
students are tnost likely to atisver correctly If they have been 
taught the specific material covered by a test and If they 
have been frequejitly exposed to the test format. (Cooley S 



Lelnhardt, 1980, p. 22.) 



Of the four process constructs 



assessed 



In IDS, 



opportunity Is the strongest,.- most consistent predictor of 



achievement gains. 



within opportunity, the variable that 



stands out ' Is that which assesses the degree to which the 
children iii the . cJ assf oom had ah opportunity to learn what was 
in the end-of-year achievement test. - 



One implication of the Importance of opportunity Is that 
evaluation studies that do hot Include liifbfmatldn dii how time 
is used or on the degree to which the curriculum Included what 
the achievement test measured are suffering from specification 
error. That 'is, there is a danger of attributing 
Instructional effectiveness to ipeclflc prbgramf or ways of 
teaching \Aien It Is really a matter of the currlculua content 

being a good fit to the particular achievement test that 

t__ 

happened to be selected. (Cooley & t^inhardt, 1980, p. 23.) 
fihat IDS helps us to iee is that until we control for the sasslve 
variation by classroom in time spent in academic areas and the content 
covered, we are unlikely to- find other process vari-ablec that are 
Inportaht. That- doei not «ean that these other variables are not 
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important^ only that discovery of Chelr Importance Is hampered. 

Let me turn now to the third piece of research on which* that I want 
to report. This study was carried out between 1977 and 1980. It Is a 
sttidy of reading Instruction In classrooms'' .Jfor tfie learning-disabled. 
It was carried but by William Cdbley, Naomi Zlgmbhd, and myself 
(Leinhardt, Zlgmond, Cooley, 1981). 

Reading Ihstructlbh and /Its effects were examined for ^05 
* students In elementary classrooms fbr the learning-disabled. 
Extensive detailed observations of students, teachers, and 
Instructional material were used to explore the plausibility 
of a causal model of the effects of reading behaviors and 
Ihstructlbh bh ^studehts' readlhg perfbrmahce. The results 
indicate that 72 percent of the variance in ^ posttest reading 
' scores can be explained by a model that Includes a pretest » 
three studeht readlhg behavlbrs, and Ihstruc tlCbfial overlap; 
and that 59 percent of the variance Ih studeht time spet^t In 
reading can be explained by a** model that includes pretest, 
teacher Instructional behaviors, teucher affective behaviors, 
and ihitructlohal pacing. (telnhardt, Ztgmond, & CooXey, 
1981,. p. 1.) » " 



{ 
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the number of children classified mm learning ^iaabled 
has risen dramatically during the past decade, from 120,000 in • 



1966 to 1,261,395 In 1979. One of the primary reasons that 
elementary school children are diagiioled aa learning disabled 
and aasigned to apeclal claiirooms li that* they exhibit 
relatively poor performance In reading. Within LD classrooms, 
reading ItisErucElon Is given considerable emphasis, and a wide 
variety of instructional practices and materlali are 
tried. . . 

In this InveitlgaClbn, we purlued aniwers to three major 
questions: (a) What la the nature of reading activities Iti ZD 
classes? ( b) What types of student activitiea lead to 
greatest improvement In reading test performance? and, (c) 
What types of Instructional situations genera Ce these Student 
activities? 

Two basic assumptions about effective reading instruction 
guided bur data collection and Sfialysta activities. First, we 
assumei that what atudehts learh la a function of what they 
do, and that features of the curriculum and teacher behavlori 
Influence what students dd rather than directly influencing 
what they learn. Second, we aiiuned that beginning reading 
activitiea fall into three broad catigbrlci: thbie' directly 

related to the reading tank in that they involve tha atudent 

_ _ > _____ 

reipbhdlhg to print; thoae that Indirectly aupport aoia 

aapect of reading, but ar« not reading (e. llatcnliig to 

the teacher, or talking about a atbry); and thoae that ari lb 

tangential to the acquiaition of reading coipetanca mm to be 
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ndn-reaaing (e. g. , voriang with perceptual training boards^ 
or doing auditory discrimination tasks). : We imposed this view 
of reading instruction and reading behaviors oh our 
observational system; we did not define reading simply as 
what goes oh during allocated reading time, nor as what a test 
manual describes as cbmpbhehts of readihg. (Leihhardt et al., 
1981. pp. 3-4.) 



DaCa Oh the classrooms, students, and teachers were 
obtained in a himber of ways. Teachers were observed directly 
and interviewed. Students were observed directly, ' and their 
work products and assignments monitored. In addition, 

students were tested and Cheir prior test ditta were also 

t- ------------ 

recorded. For all data collected the Ihdlvidual child was the 

unit oi observation and analysis, this was justified^ because 

of ' the totally ind Ividuallied instructional programs. 

Classroom observacions and teacher interviews yielded 

information on a wide variety of variables. (Leinhardt et 

al., 1981, p. 5.) 



Both the teacher ahd student were observed directly in 
this study. Several measures of thetr behaviors were recorded 
using a time sampling procedure (Studeht-tevel Observation of 
Beginning Reading) (SOBR) . . . (telnhardt 4 Seewald, In 
pre^). 
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Teacher be haviora , teacher behaviors were observed and 
linked CO the student<s) to whom they were directed. The two 
basic areas of teacher behavior recorded were lost rue tlonal 
and affective. Instructional behavlori included model 
presentations, explanations, feedback, cueing, and mbhltorlhg. 
these measures were obtained from time samples taken every 
five minutes for one hour, • • These separate measures were j 
combined into a ilngle eatimate of the time an individual 
child received teacher instruction each day. Affective 
behaviors included the nuaber of reinforcers received by each 
child per day and the cognitive press exerted by the teacher 
toward a child. . . ; 

{■ 

Student behaviors . Figure 2 displays the schema used to 
organize the bbservatiohs of student behavior. The system 
used in this study (SOBR) waa designed to assess what students 
actually did during reading instruction. A detailed analyais 
of reading behavlbra coupled with an assessment of the tssks 

_ _ y _ 

presented to children diirlhg reading formed the bases of the 
observational system. The system was ihteiided to be 
exhauative, in that all of the students' time dUrlhg 
observation would he sccoonted for. Students could be resding 
or hot. If they were reading, these behaviors were clssslfied 
further ss direct or indirect. Direct resdiii|' behiviori 
Incliided orst and silent resding of letters, words, .sentences , 
and parigrsphi. Ihdirecc reading behavior a were those 
sctivities that were assumed to be relited to raiding but Iti 
which the student was not sngaged in responses to print in the 
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"normal " way. By normal we mean going from print (as 
itlmulus) to sound or silent reading (as response) si opposed 
to fliif iiig letters with a specific sound. the indirect 
reading behaviors Include story discussion, circling pictures 
with a common phonefic eteuent* listening* and writing, 
whether copying or spelling. The cdnblhed measures of reading 
used In this study included the amount of time per day a child 
was reading aloud, reading silently, or engaged in indirect 
reading behaviors. 

Insert Figure 2 here 

5 

In addltibtv to reading categories there were five 
non- reading categories observed and recorded. The hbh- reading 
categories were: waiting for something or someone; academic 
activities other than reading; management activities 
including preparing for a task or wrapping-up after s task la 
completed; absent from ichbol; br, but of Che room at the 
time of observation. ^u^tHer, off-task during reading was 
dlstlngulihed from off-task during other ki^ds of 
activities. . . 

The claaarood obaervatlona of the 105 LD atudenta took 
place over a 26-week period^ from December 1976 to May 1979. 
For each claasroon, we randomly aaapled twenty one-hour 
bbservstion ieiilbni In Che abrnlng and ten In the afternoon. 
Thua, each claaaroom waa obaerved for about 30 hburi bver Cte 
20 weeks. Thla conalderable effort at extanaive aaipling waa 
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to assure adequate cov^sge and stability of the phenomena of 
ifitereiC (KarWelt & Silvan, I9B0). 

Raw counts were weighted so that froa our thirty 
observations per student we could estimate the classroom 
behaviors of each student between pretest and post test. 
Weights., were i fuhctlbn of the reciprocals of the iamptlhg 
ratios, that is, if we observed a student for 20 morning 
hours, snd s/he was in school for s total of 320 morning 
hours, then the weight for the AM observations would be 
320/20, or 16. Similsrly, if s itudeht was observed for 10 PM 
hours, and s/he wss in school for 300 afternoon, hours, the 
estimates for the PM strata would be weighted by 30. The 
weighted estimates were then icaled so that they approximated 
the minutes per day a child averaged in a particular activity. 
The complete sampling and weighting procedures are described 
In Cboley and Mao (t980). (Lelnhardt et al., 1981, 
pp. 10-U,) 



The major objectives of this study were to determine how 
the sctivitlei that itudenti engaged in affected their test 
performance, and how a variety of Initructlonal fiaturei 
influenced student behavior. these relationships wera 
exaatned by a series of multiple regressions. the variables 
to be included In each rigreiilon were detcrmttted by a model 
for explsining reading achlevsnent* • • 
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Figure [3] displays the combined causal model of how the 
variables are assumed to be influencing each other in the 
classroom. It summarizes the two functions deacrlbed above. 
Solid black lines indicate significant relationships that are 
time driven, and in which the directionality of the arrow 
seems clear (e.g.^ pretest to posttest). Broken black lines 
indicate significant relationships in which we assime a causal 
. directionality, but in which both variables were measured at 
approximately the same time (e.g. ^ teacher instructional 
behaviors and time in reading activities). Dotted lines 
Indicate relationships that we predicted would be significant 
but were hot. 



It is important to note that in some cases combined sets 
of reading variables are used and in some cases single reading 
variables are used. For ex^ple, teacher affective Support ts 
aimed at increaaing all of the students' reading activities so 
the total reading time was the appropriate dependent varlsble. 
Posttest, however, ts alaumed to be Influenced primarily by 
•ilent reading, somewhat by oral reidlhg, and very little by 
indirect reading activities, so these are exaained separately 
in their role as explanatory variables. This distinction is 
not aade nerely for the purpose of conserving degrees of 
freedom, btit because of the logic of the relationships. 



Insert Figure 3 here 
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The ailti point of Figure [3] Is to show that posttest !• 
iisuoed to be dependent oh student behaviors snd Instructional 
content; student learning behaviors are assiaed to be 
Influenced by prior test performance ind teacher 
behaviors- . . The regressions reported below the figure 
indicate that pbstteat . . . perforaaace Is signlf Icafltly 
Influenced by pretest i silent reading time, and overlap, but 
hot ilghlflcantly Influenced by oral reading or indirect 
activities. (Oral reading time waa significant when an oral 
reading test was used and no overlap estimate wis Included,) 
Theae results suggest that an average of one minute per day of 
additional silent reading time increases posttest performance 
by one point. An increase of five minutes per day would be 
equivalent to about one month (on a grade-equivalent Scale) of 
additional reading achievement, 

turning to thje factors that Increase time apent by 
students In direct and indirect reading behaviors , • < From 
Figure [31 we can see that total time In reading waa expected 
to be influenced by What atudents knew In the beginning, what 
the teacher taught them, how the teacher encouraged or cajoled 
them, and the pacing of inatructibh. All bat the lait of 
these are verified. The rsgresslbn suggests that ah Ihcraaae 
6f one minute of teacher tnatructlon per day galna a minute of 
atudent reading time, and each relnforcar alao Incraaaea dally 
reading time. Given theae reaulta, teachers Coiita incraaae 
IhitructloSal time to several atudenta at ohca. The pacing 



it, that la, lacE of a algotf leant relatlonahlp, may be 
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explained by the fact that these teachers tended to adjust the 
pacing .. to the level of student ability so that students of a 
given ability were not differentially "pushed" by longer* or 
shotcer asstgnnfnts. Indeed, the ^ strong zero order 
relationship, .46, between pacing and pretest suggests this, 
but its partial regression is not significantly different from 
zero. (While this Is different from the results of Barr, 
1980, the model being tested ti also different.) 

We spent over two years studying these classrooms. Much 
of the Information we obtained Is captured by the specific 
variables and analyses . . . presented so far. Much more, 
however , was also learned. In fact, after observing 
classrooms and teachers (some for more than 70 hours), [I] 
feel obliged to report what we have learned from both our more 
formal and less formal analyses. It Is the latter experience 
that grounds the former and makes It more than a collection of 
nuabers. thus, there are two classes of findings from this 
stucvt those that deal vlth the state of the art of research 
on effective classroom processes and those that deal with the 
substantive Import of our findings. 

After decades of effort, research oh instructional 
^ domains has reached a point where ctSssroom processes can be 
measured with reliability and validity. This is due to the: 
improv«i strategies for sampling the ixiitructlonal domain; 
precision with which observational measures can be crafted; 
incorporation of Interpretable aetrics Into the observation 
iyi tern (namely time); and, heuristic value oi a causal 



20 



Pige 18 



Bcheoie ^ 

Improved strategies for iimpllhg include capturing more 
of the time than most previous %rork (30 hours), and randomly 
iampliiig Che time of observation. Previous work has used as 
little as two hours and has intentionally waited until 
instruction "began" » thus inflating estimates of instruction. 
In this study, the use of schema to organise the observational 
measures dramatically improved the reliability of observers 
and eased final analysis. Using a unifying metric for the 
majority of measures improved analysis and ihterpretability as 
it has for other researchers in the area, notably the BTES 
work. Using a causal model has helped to Clarify the paths 
through which variables may be operating. Specifically, It Is 
student behaviors during instruction that influence student 
learning, while teacher behaviors Influence student behaviors. 

(Leihhardt et al. , 1981, pp. 17-23.) 

This set of three studies traces both thinhlng and findings about 
Inst rue tiotial time. In the Science Study i we considered a modified 
estimate of allocated time to be useful In underatanding atudent 
end-of-year performance. At that atage in my thinking, time was simply 
a blocked competitive reaource that needed justification. In IDS, 
somewhat more complex measures of time, attendance^ and on-taak ratea 
were used to try to get at aomething more relevant for Inatruction than 
allocation. As we began to underatand the Importance of Content 
covered, we tried to move to«mrd notiona of time apent In appro priite 
taaka. The t-D StSdy carefully defined the Inatructlonal domain, 
heavily aampied it and acaled It In termi of time. 



21 



Page X9 

a 

Having reviewed this research, I would like to turn now to six 
basic findings that have emerged from the study of instructional time. 

t. First* time Is most usefully thought of as a metric not a 
variable* 

2. Second, time spent Is overlapping ^ud not mutually exclusive 
with one organism even when the focus Is primarily on one type 
of acctvicy. 

1. third, observations and Interpretations must bV at the same 
level. This Is not the same as unit of analysis. It is the 
problem of kids spending four Co ten minutes a day reading 
while teachers are spending two to four hours a day teaching 
read Ing . 

^_ y_ 

A. Fourth, allocated time Is not the upper bound for engaged' time 
in some situatlonst while It Is the upper bound for others. 

5. Fifth, time on task is not the same as time oh the right task. 

6. Sixth, to obtain a stable, generallsable estimate of students^ 
time usage, there must be extensive sampling and extremely 
well-defined variables^ 

Let us now look at each of these pointa aeparately. 

Time li a^ metric not a^ variable . By that I mean the pasaage of 
time ia in itself of ho particular value tb any reiearch effort or any 
question. It Is wlme aa a metaphor or time aa a metric for abmethlhg 
else; Aa a metaphor. It li useful In considering time ss s resource ^ s 
relatively flhlte resource vlth reipect to Che conitfiert ilchotigh not 
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pirClcuIarly . ftntCe with respect to itself. As s aecric, it is useful 
because it perairs us to scale vsrisBtei in a wsy CHie permits CHetr 
addition and subtraction. However, csution is needed once behaviors or 
variables have been scsled in the Metric of tine, they sppear to hsve 
sn equivalence tHae amy be false. One minute of tescher contact in 
Category Y is not the saie as one aihuEe of student behavior tn CiCegOry 
X, and issues of intensity and density need to be addressed, time can 
be a deceiving fietric. bat it is useful with respect to policy 
recboaendatioh and iwith respect to notiotii of iaprovolene and change, 
it is also th« ietric that gives us the greatest shocK value. 
Renesibering that we are only estiaating from saaples. ve seea to 
diicover iurprislngly saall aaoonts of "tiae spent in activities that we 
presuae have high payoff for a vsrieEy of Scadealc areis. 

Tine is overlapping and not autually exclusive. By this , 1 sa 
referring to the fact thit several behavior* go on st once within.»one 
child or teacher, two or aore things caii occur siaultsneously , so that 
they slightly overlap, or erclusively. This indicates that the 
SxHatloti of time mimt be done with care and precision. Ve aust know 
the bbufidaries at which we are sumitis. For exaaple, consider a table 
that displays the following percentages, **B0 percent of Che tiae 
reading, 75 percent of the tiae in ibciai contact, 65 percent of the 
t iae in contact with the instructional leader . " When all these 
percentsges sre above 50, the interpretability gained by using tiae is 
los:. Caution is needed in deciding which eleaeht can be carved neatly = 
Mwif froa «fhich other element. 
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Obftervations ^nd Interpretations aust be it ^|>e iaae 4evei- My 
thrra point Is the hbtibh that different tctors in the same envlronaent, 
spend very different amounts of time in the same activity and that 
estimating one from the other Is difficult. If we itudy the time uf»e of 
children and attach teacher behaviors to the child's time, we cannot 
estimate the teacher's use of time. Because a child receives less than 
a minute a cay of cognitive instruction and sbout i5 minutes a day of 
instruction relevant In some way to reading, we cannot Infer that the 
teacher wasn't working at teachtng reading. Tescher time has to be 
estimated ieparately, and Ilhltage may be a problem. Allocat ed ^rie <iay 
je ^he ^tppBT ^ound jef engage d ^me . Clearly^ allocated time Is 
pretty close to being the upper boand for mathematics tnitructloh. Very 
little formal mathematics Instructlbh goes oh in shy class other than 
math class. My concern with this notion of allocated time being the 
upper bound for engaged tine stems from the Science Study described 
earlier. Remember, time spent In science Influenced science, raadltig'^ 
and math achievement. -This li not aim^^ly « aattir of rideflhXiig 
allocation. It li i problem In uhderstahdlng the total ihstructlohal 
day. Ve heed that understshdlog in order to address the quastion^ 
"Shou?' we allocate more reading tlma in order to get mora angagcd 
reidlitg time, or ihould ue permit allocited raiding time to itay ii It 
Is?** "Buying**^ more reading allbcatloh will occur at Che cost of social 
•tudies or science or music, houever. chat Clma' spant will also have 
payoff in the area known as reading coaprahension. The policy 
implications of this iisue are clears 
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Tine oh task Is not the s^ffle as tiae on the right task . My fifth 
point is ons that we certainly all understand. But needs to be sweated 
frequently. Time on task is synonymous with engagement In relevant 
tasks only when the task content has been controlled for. Mucti tffthe 
time oh task literature merely takes children being on task during the 
time allocated to Ihstructibhal Area X with ho regard to the content of 
the task they are performing. This notion fits very closely Ihto the 
Idea that time Is a metric. In order for one to do a study of time that 
is meaningful, a detailed ahalysis of the cbhteht of Instruction must be 
carried out. . Siaply taking a percentage of bh-task behavior ahd 
mulciptylhg IC times allocation will not give you ah engagement rate 
that Is useful, as we learhed in IDS. 

Ther^ ±£ * tensive sampHhg ahd Well-defined variables . 

The sixth and Final point^i^ais with methodblbgy. In a geheral liability 
study that w^s carried out as a part of the L"D Study, we discovered 
that in order for estimates of studeht behavior to stabilize^ we needed 
to have extensive sampling of those behaviorS (tbmax, 1980; Cooley & 
Mao, 1980). 'Specifically/ 20 hours were needed as bppbsed to the two or 
three usually recommended. This targe time sampling was not necessary 
for all variables, but it was hecessary for »any of the less frequently 
occurring ones. In addition tb ianplihg the behavior*, adequately 
deflhlhg thea carefully is as important. As we get better at deflhing 
tiaki, activities, ahd behaviors, our ability to connect them becomes 
improved. 
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^ Having reviewed sample s of the last dec sue' s work, I would like now 
y/to turn to what we need to do in the future. One area that I think 
would be interesting would be Co unravel teacher Cine. We Have done a 
fairly good job of uhderitahdihg a student record; that is* taking a 
cKild, explaining how that child spends a day, and tagging on to It the 
resource that that child has access tcr^ namely the amount of teacher/ 
time the child has access to. But we haven't looked^ at it from Che 
other etid; Chat Is, the understand i|ig of how teachers d"! attribute their 
day in terms of tljoe. I think that we'ri going to need to understand 

Chat if we're going to reform how teachers get children to spend time. 

_ ____ _^ 

The best work chat I know of Chat"! going on now is Che Ceacher planning 

and teacher decision making sCudies. Linking chac work wich Che cime 

issue would be exciting. 

_ V _ 

The a^cond area thaC I think we ought to work on is Che noCion of 
multiple payoffs, that Is, the ndtlbhs that were Ihltlally described la 
the Science Study. Clearly, we begin to get payoff especially in 
reading for things like time spent In ^rama, time apent in arMa that 
Involve high content and contact with print but that aren't called 
reading. But we're going Co find ouC abouC Che. efficacy of using that 
cime only as ve begin Co analyxi Che apecific skills cha.c are required 
fbr Che Cesc performance wlch crlcerlon measures or whacever you wane Co 
use^ and we do a similar analysis of che ocher curriculum concVnc arcaa. 
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In the future, we need to analyse carefully the task cbmpbhehts In 
a virlety of subject astter donalna; science, reading, social studies, 
aatheaatics, and auslc irould be ay ciridldatei. These sfsalyses then need 
to be compared so that we can construct portraits of a student's day arid 
asp those on to the more complex sspects of student achievement that we 
all hope to use someday* Figure 4 displays a simple version of what I 
have in mlhd. the point Is to examine how various areas of InlCtuctlon 
support each other in mei^ngful ways. Humanistic educators have long 
argued against back to basics. In part because of the enrichment value 
that Is lost when the other iubjecta are deleted. But more may be being 
lost. There may, In fact, be soae ipeclflc "basic*' skills being lost as 

_ _ _ 

well. For example. In ay purely hypothetical case, reading connected 
prose silently takes up* 15 minutes In reading, 10 minutes In math, and 6 
minutes In 8cienc|. Oral reading takes up 10 minuses of reading, 3 
minutes of math, aWd is negligible In science. Writing Is dbtie for 5 
minutes of. reading, but 20 minutes fef science time. If we remember why 
we are siipposed to itudy the "baalcs", perhapa It will be no surprise 
that children In subject area classes spend time exercising theie basic 
skills and engaging In them. In fact. In at least one ich66I In 
Pittsburgh, there Is no sllocsted reading time after third grade 
making way for expanded social studlei, clVlci, aod science classes. 
M^'pping these activities out and demohitratlng Ehett relationship to 
ootcomes Is a non-trivial task and will take us quite a few peridh years 
of work. Simultaneously, we have to build more complex analyses of 
existing tests and hopefully track areii of Instruction where time is 
spent but never assessed (clear oral presentstlbn, for exaaple)- 

2^7 
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COnclu»Ion> 



In sum, ny recoanendatlon is that we continue to investigate the 
preasing probleaa of education; how to help poor achievera learn more 
easily and In greater depth; how to keep the gifted and talented 
ehatXenged; how to oake out |chooIi nurturatiC, attractive placet la 
which chi Idreh experience the beginnings of the wondrous adventure of 
life; and that we continue these investigationa using tine ss the 
powerful metric we have seen It Is but while wending our way carefully 
between the Scylla and Charybdla of overly ilmptiatlc Interpretations 
and overly complex bbfuscatiohs of real It/. 
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